Universal Access To All Knowledge
Home Donate | Store | Blog | FAQ | Jobs | Volunteer Positions | Contact | Bios | Forums | Projects | Terms, Privacy, & Copyright
Search: Advanced Search
Anonymous User (login or join us)
Upload

Reply to this post | Go Back
View Post [edit]

Poster: MACHiNESMiTH Date: Jun 3, 2014 10:36am
Forum: forums Subject: GameSpots Robot.txt is breaking Wikipedia

Wikipedia features a lot of archived links from Gamespot.com via Archive.org - From what I understand a recent change blocks new content from being shared. What I DONT understand is why all the previous content prior to the robots.txt update (i.e. ~1996 to 2007) is no longer available? Much of which can no longer be accessed via the original site since it's been lost to various changes over time. Many Wiki article references just blurt out the robots.txt error message now.

a Discussion between wikipedians has been ongoing since April: http://en.wikipedia.org/wiki/Wikipedia_talk:WikiProject_Video_games#GameSpot_robots.txt.3F

And an attempt has been made to address it at GameSpot too: http://www.gamespot.com/forums/bug-reporting-feedback-1000006/addition-of-robots-txt-is-breaking-the-internet-ar-31291462/

However I didn't see any mention of this being brought up here - which is a shame since a huge chunk of gaming history resides on this site. Any advice on what can be done ? Thanks for Reading!